Ensemble Methods for Multilayer Feedforward
نویسندگان
چکیده
Training an ensemble of networks is an interesting way to improve the performance with respect to a single network. However there are several method to construct the ensemble and there are no results showing which one could be the most appropriate. In this paper we present a comparison of eleven different method. We have trained ensembles of a reduced number of networks (3 and 9) because in this case the computational cost is not high and the method is suitable for applications. The results show that the improvement in performance from three to nine networks is marginal. Also the improvement of performance of the different methods with respect to a simple ensemble is usually less than 1%.
منابع مشابه
The Mixture of Neural Networks Adapted to Multilayer Feedforward Architecture
The Mixture of Neural Networks (MixNN) is a Multi-Net System based on the Modular Approach. The MixNN employs a neural network to weight the outputs of the expert networks. This method decompose the original problem into subproblems, and the final decision is taken with the information provided by the expert networks and the gating network. The neural networks used in MixNN are quite simple so ...
متن کاملSome Experiments on Ensembles of Neural Networks for Hyperspectral Image Classification
A hyperspectral image is used in remote sensing to identify different type of coverts on the Earth surface. It is composed of pixels and each pixel consist of spectral bands of the electromagnetic reflected spectrum. Neural networks and ensemble techniques have been applied to remote sensing images with a low number of spectral bands per pixel (less than 20). In this paper we apply different en...
متن کاملApplication of ensemble learning techniques to model the atmospheric concentration of SO2
In view of pollution prediction modeling, the study adopts homogenous (random forest, bagging, and additive regression) and heterogeneous (voting) ensemble classifiers to predict the atmospheric concentration of Sulphur dioxide. For model validation, results were compared against widely known single base classifiers such as support vector machine, multilayer perceptron, linear regression and re...
متن کاملStacking MF Networks to Combine the Outputs Provided by RBF Networks
The performance of a Radial Basis Functions network (RBF) can be increased with the use of an ensemble of RBF networks because the RBF networks are successfully applied to solve classification problems and they can be trained by gradient descent algorithms. Reviewing the bibliography we can see that the performance of ensembles of Multilayer Feedforward (MF) networks can be improved by the use ...
متن کاملThe Mixture of Neural Networks as Ensemble Combiner
In this paper we propose two new ensemble combiners based on the Mixture of Neural Networks model. In our experiments, we have applied two different network architectures on the methods based on the Mixture of Neural Networks: the Basic Network (BN) and the Multilayer Feedforward Network (MF). Moreover, we have used ensembles ofMF networks previously trained with Simple Ensemble to test the per...
متن کامل